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Abstract. In this note, we formulate and prove a branching rule for simple polynomial 



modules of the Lie superalgebra g[(m|n). Our branching rules depend on the conjugacy 
class of the Borel subalgebra. A Gelfand-Tsetlin basis of a polynomial module associated 
to each Borel subalgebra is obtained in terms of generalized semistandard tableaux. 



o 



' 1. Introduction 

Let 5J [(m) be the general linear Lie algebra and consider the subalgebras 

+3. 0[(1) Cfl[(2) C ... Cflt(m), 

where we embed Ql(k) C Ql(k + 1) as the collection of matrices whose last row and column 
are zero. Then given a finite-dimensional simple g[(m)-module L m (A), we may restrict 
the action to view L m (X) as a g[(/c)-module and decompose it into simple g[(£;)-modules 
T ^ \ Lk(fJ,); when k = m — 1, this decomposition is called a branching rule. When k = 1, 

■ this decomposition describes a linear basis for L m (A), which is called the Gelfand-Tsetlin 

basis ( [GW1 Chap. 8]). There are several generalizations and applications of the Gelfand- 
Tsetlin basis ( |Moj ) . Moreover, this basis has an innate combinatorial description in terms 
of semistandard Young tableaux, and hence can be used to derive some combinatorial 
identities. 

In this note, we generalize these concepts to the general linear Lie superalgebra gl(m|n). 
It is known that there is a branching rule for the standard Borel subalgebra of upper- 
triangular matrices ( |BR| ). Using Howe duality ( [CW21 ISel| ). we formulate and prove a 
branching law with respect to an arbitrary choice of Borel subalgebra b, and in particular 
our approach provides a novel proof for the standard Borel case. We then deduce the 
existence of a Gelfand-Tsetlin basis parametrized by certain tableaux, which we call "b- 
semistandard" . This provides a representation-theoretic proof that the number of these 
tableaux is independent of the choice of b ( [Kw| ) . 

Acknowledgement. We are grateful to Weiqiang Wang for his suggestion for this 
collaboration, and for the guidance and advice he has given over the course of this project. 
We would also like to thank Shun- Jen Cheng for his many helpful conversations. The third 
author was supported by an REU under Wang's NSF grant. 



2. Preliminaries 
In this note, the underlying field is always C, the complex numbers. 
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1 



2 



CLARK, PENG, THAMRONGPAIROJ 



2.1. Partitions, Young Diagrams, and Tableaux. Let A be a partition of n; that is, 
a sequence A = (Ai, A2, • • •) of non-negative integers with A, > Aj+i and |A| = £V = n - 
The length of A, denoted by l(X), is defined to be the number of non-zero entries of A. Each 
partition corresponds to a unique Young diagram, and we will freely identify a partition 
with its corresponding Young diagram. We denote the conjugate partition to A by A'. 

A partition A is called an (m\n)-hook partition if A m +i < n. We denote the collection 
of (m|n)-hook partitions by P m \ n . 

Given partitions A and li such that Aj > m, let X/fj, denote the skew Young diagram. 
We will say that a skew diagram is a horizontal strip (respectively, vertical strip) if each 
column (respectively, row) of the diagram contains exactly one box. Recall that given 
two partitions A and fx, we say \i interlaces A if Aj > \i{ > Aj_i for all i. Then a skew 
diagram A//i is a horizontal strip (respectively, a vertical strip) if and only if \x interlaces 
A (respectively, // interlaces A'). 

Let A be a set. A Young tableau with entries in A is a Young diagram with an element 
of A inserted in each box; we will call A an alphabet, and an element of A a letter. Let A 
be a partition and \i be an arbitrary sequence of non-negative integers indexed by A such 
that X^aeA^a = \M' By a Young tableau of shape A and content fj,, we mean a Young 
tableau corresponding to partition A such that each letter a 6 A appears in fi a boxes. 
When convenient, we will also use the notation [i = {a^ a ) a ^A- 

2.2. Littlewood- Richardson coefficients. Let a and jx be partitions of length at most 
m. Given a third partition A, let be the Littlewood-Richardson coefficients. One way 
to interpret these non-negative integers is as multiplicities: 

L m (a)®L m (/x)^0L m (A)© c "M. (2.1) 

A 

Proposition 2.2.1. Let X, fi and a be partitions. Then 

(1) c A M = cLj and c A ^ is nonzero only if \fi\ + \o~\ = \X\. 

(2) <2y = 4„. 

(3) Suppose further that fi = (n), a one row partition. Then c^t n ) * s e *^ er 1 or zero. 
Moreover, c^r n \ = 1 if and only if the skew shape A/a is a horizontal strip. 

(4) Suppose further that fi = (l n ), a one column partition. Then c\ in % is either 1 

or zero. Moreover, c^n n \ = 1 if and only if the skew shape X' /a' is a horizontal 
strip. 

We refer the reader to |CWH Appendix A] or [Sa] for the details. 

2.3. The Lie superalgebra gl(m\n). The general linear Lie superalgebra g = gl(m\n) 
is the vector superspace of (m + n) by (m + n) complex matrices, with the block-diagonal 
even subspace Qq = fll(m) © Ql(n). 

The standard Cartan subalgebra f) is the set of diagonal matrices in g[(m|n). Let 
hi := En G f) be the elementary matrices with a 1 in the entry and in all other 
entries, for 1 < % < m + n. For 1 < % < m, 1 < j < n, let Si,€j be the elements in f)* 
defined by 

Si(h k ) = \ k 

where A x ,y = 1 if £c = y, and otherwise. The set {<5j,ej|l < i <m,l < j < n} forms a 
basis of h*. 
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The root system $ of q is the set 

$ = {6~k - Si,ei - ej,5 k - ei\l <k,l<m,l< i,j < n} . 

The Weyl group of 0[(?ti|ti) is isomorphic to S m x S n , where S m permutes the S^s and S n 
permutes the e,'s. Note that not all simple systems are VF-conjugate. In particular, there 
exist different choices of positive systems (and hence different choices of Borel subalgebras) 
that are not VK-conjugate; see |CW14 Section 1.3]. 

2.4. Borel Subalgebras. By an e-5 sequence for g[(m|n), we mean a sequence of m 
(indistinguishable) S's and n (indistinguishable) e's. For a given e-5 sequence s, we can 
assign the indices 1, . . . , m to the 5 and the indices 1, . . . , n to the e by the increasing order 
in which they appear. Then II(s), the set of sequential differences of the indexed letters, 
forms a set of simple roots for For example, H(e55e) = {ei — Si, Si — 62,62 — £2}- 

It is easy to check that any simple system is VF-conjugate to H(s) for some s. Moreover, 
if s and s' are distinct e-5 sequences, then II(s) and II(s') are not conjugate, so these 
sequences index the simple systems of <3? up to conjugacy. 

Let 3> + (s) be the set of positive roots relative to n(s) for some sequence s. Then we 
define the Borel subalgebra corresponding to s to be 

b(a) = f)© 9Km\n) a . 

d£$+(s) 

Note that the even subalgebra b(s)g is independent of s; indeed, b(s)g is exactly the 
standard Borel subalgebra of Ql(m\n)-Q = gl(m) © fll(n). 

Any Borel subalgebra is conjugate by inner automorphisms to b(s) for some s, and b(s) 
is not conjugate to b(s') if s 7^ s'; therefore, for the remainder of this note a Borel subal- 
gebra will mean b(s) for some e-5 sequence s, and we will abuse notation and identify the 
subalgebra with its corresponding sequence. For example, the standard Borel subalgebra 
of upper triangular matrices in gl(m|n) is represented by the sequence 




2.5. Polynomial weights and hook partitions. Let oj = YliLi Mi^i + Sj=i u j e j e b *• 
We call oj a polynomial weight if in and Vj are non- negative integers for all i,j. 

Fix a Borel subalgebra b. Then each (mjn)-hook partition A corresponds to a polyno- 
mial weight as follows. For 1 < i < m and 1 < j < n, let d\ (resp. ej) be the number of 
e's (resp. 5's) appearing before the i th 5 (resp. j th e) in b. For example, if b = 55e5e5, 
then 

di = c?2 = 0, CZ3 = 1, d 4 = 2, ei = 2, e2 = 3. 

For 1 < i < m and 1 < j < n, let pi = max{Aj — di, 0} and qj = max{A^- — ej, 0}. The 
pair (j?i,qj) is called the b-Frobenius coordinates; cf. |CW1| . Then set 

m n 

i=i j=i 

When b = b st , there is a simpler description. Define the partitions /j, — (Ai, • • • , A m ) 
and a = (A m+ i, A m+2 , • • •)'• Tnen we define \^ = A bSt = YaLi V%Si + YJj=i 
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2.6. Polynomial modules of g[(m\n). An fy-semisimple module M is a polynomial 
module if the weights of M are polynomial. In this note, by polynomial module we 
always mean a finite-dimensional polynomial module. 

Given a weight u and a Borel b, let L(b,u) be the simple module of highest weight u 
with respect to b. When b = b st , we use the shorthand L(uj) = L(b st ,u). Then we have 
the following result (cf. [Kl ICKl [CLWl ICWl ] ) . 

Proposition 2.6.1. Fix a Borel subalgebra b. 

(1) {L m | n (b, A' 1 ) : A E P m \n) is a complete list of pairwise non-isomorphic (finite- 
dimensional) simple polynomial Qi(m\n) -modules. 

(2) L mln (b,\ b ) = L m]n (\*). 

(3) The category of polynomial modules of g\(m\n) is a semisimple tensor category. 

3. Branching rule for g\(m\n) 

3.1. Branching Rule. Fix a Borel subalgebra b. Let b be the e-S sequence obtained from 
b by deleting the last entry in the sequence b, and rh (respectively, n) be the number of 
<Ts (respectively, e's) in b. Also set h = h m S P) if n = n and h = h m+n if rh = m. Then 
we have a natural embedding 

0[(m|n) = (je g{{m\n) a 

where b. Ch = b, . With respect to this embedding, we have the following branching rule 
for an arbitrary Borel subalgebra. 

Theorem 3.1.1 (Branching Rule for g[(m|n) with respect to a general Borel). Let A be 

an (m\n)-hook partition and b be a choice of Borel subalgebra for gl(m\n). In the above 
notation, 

L m \n{b,^ b ) i g l(rh,h)— ^m|n(^) cjb ) 
a 

where the sum is taken over all {fh\n)-hook partitions a such that 

(1) a' interlaces A' if m = rh, 

(2) a interlaces A if n = h. 

Proof. First recall the statement of super Howe duality: as g[(m|n) x g[(/c)-modules, 

S{£ m \ n ®C k )^ L m \ n (b,\ b )®L k {\). (3.1) 

l(\)<k 
<\ m +i<n 

Let p = gl(rh\h) x gl(m — rh\n — h). Restricting (|3.1f) to a p x g[(fc)-module yields the 
decomposition 

S(C m|n ®C fc )| pX8l( ^ L m \ n {b,\ b )®L k {\). (3.2) 

l{\)<k 

On the other hand, evidently S(C m l n ®C fc ) | pxg i (fc) = S(C A l"®C fc )®S(C m -™l"-™®C fc ). 
By applying Super Howe duality again to each tensor factor, we see that 

5(C n|n g, C fc } ; pxfll(fc) ^ £th|ft (g j a b) % Lfc(cJ ) g, L m _ A |„_ fi (0, /x e ) ® L fe (/x), 
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where the sum is taken over all a and [i such that a is an (m|ra)-hook partition with 
1(a) < k and [i is a (m — m|n— ra)-hook partition with l(\i) < fc, and the notation #=<5(resp. 
e) if n = n(resp. rh = m). In particular, since Q\(m — m\n — n) = C, L m _^ n _f l (9, fi e ) is 
1-dimensional and thus 

5(C m l« ® C fc ) | fl[(rh | ft)XflI(fe) = 0X H(i (M { ) ® (L fc («r) L fc ( M )). (3.3) 

Then using (|2.ip , 

5(C m l™ ® C fc ) | flI(rh | ft)xflI(fc) = L*| ft (6, (T 8 ) A L k (\)®< 

= ©<^,a L ™|n(^, ^) ® ^fc(A)® c - (3.4) 

Comparing (I3.2p and f)3.4[> . we obtain 

£m|»(&, A") l 0l (A|n)= i™|a(MT C -. (3.5) 

Since {m — rh,n — h} = {0, 1}, ^ is either a row or column partition. The result follows 
by Proposition 12.2.11 

□ 

Remark 3.1.2. The case b = b st had been proved in [BR| using the commuting actions 
of fl[(m|n) and S d on (cM»))®d . 

3.2. The Gelfand-Tsetlin basis and b-semistandard tableaux. By iterating Theo- 
rem [3JTT1 one obtains a linear basis of L m | n (b, A b ). These basis vectors are in bijection 
with the sequences of triples (m^, n^, X k ) where m,fc,nfc are non-negative integers and X k 
are partitions satisfying the following conditions. 

(1) Either = m,k+i and = rik+i + 1 or = m^+i + 1 and nk = rafc+l- 

(2) X k is an (mfc|nfc)-hook partition. 

(3) \ k /\ k+l is a vertical strip if m& = uik+\ or a horizontal strip otherwise (or the 
empty diagram). 

These sequences may be realized in terms of certain tableaux of A. Let A denote the 
alphabet set {l, . . . ,m, 1, . . . , n} and b be the following e-5 sequence: 

b = 55 ... 5 ee . . . e 5 ... 5 e~^~e , 

where \x\ and vt are non- negative and all other /Xj, i/j are positive integers. For conve- 
nience, set vq = 0. Define the total order <(, on A by setting 

i <b j ; if 1 < i < j < m, fc <b I if 1 < k < I < n, 

r r—1 
i <b k if i < ^g an d k > f 5 for some 1 < r < t, 

9=1 3=0 

r r 

k <t, i if i > f^g an d ^ — 5^ ^3 f° r some 1 < r < t. 

9=1 9=0 

A tableau in A will be called b-semistandard if the following three conditions are satisfied: 

(1) The entries are weakly increasing along each row and column with respect to 

(2) The entries from {1, 2, . . . , m} are strictly increasing along each column, 

(3) The entries from |1, 2, . . . , n\ are strictly increasing along each row. 
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The combinatorics of such tableaux have been studied in some detail, and in particular 
it is known that there is a content-preserving bijection between b-semistandard tableaux 
and b st -semistandard tableaux; cf. [Kw| . 

Proposition 3.2.1. The module L m i n (b, X b ) has a basis indexed by b-semistandard tableaux 
of shape A which is obtained by iterated application of the branching rule. The entries 
determine which simple summand the basis vector belongs to at each application of the 
branching rule. 

Proof. Order A from largest to smallest according to b to obtain A = {a\ >{, ... >(, a n+m \. 
Then given a sequence (mk,nk, A fc ) associated to a linear basis element we can define a 
unique b-semistandard tableau: give each box in X k /X k+1 the entry a&. Clearly the re- 
sulting tableau is uniquely determined by the sequence of partitions. On the other hand, 
given a b-semistandard tableau it is evident that stripping away the boxes with entry 
oi, then those with 02, etc. defines a sequence of partitions corresponding to a basis 
element. □ 

Example 3.2.2. Consider gl(3|2) and b = 5ee55. We choose the following partitions 
A = A 1 = (4, 3, 3, 2, 2, 1), A 2 = (3, 3, 2, 2, 2), A 3 = (3, 2, 2, 2), A 4 = (2, 1, 1, 1), A 5 = (1). 
In this case, the ordered alphabet is 

1 < b T < b 2 < b 2 < b 3. 

Following the algorithm above, we find the corresponding b-semistandard tableau to be 



1 


1 


2 


CO 


1 


2 


2 




1 


2 


3 




1 


2 




2 


2 




3 







We note that if /u is the content of a b-semistandard tableau T and we write 

H= {l fll ,2' 12 ,...,m' lm ,T T ,...,n flw ) 
then the basis vector corresponding to T has weight 

m n 

i=i j=i 

3.3. An analogue of the Kostka numbers. The branching rule implies that the num- 
ber of b-semistandard tableaux of shape A is equal to the dimension of gl(m|n)-module 
L m | n (b, A b ), which is the same module as L m \ n {\^) by Proposition 12.6.11 Comparing the 
Gelfand-Tsetlin bases, we obtain the following result, which is a special case of |Kw[ 
Proposition 2.11]. 

Corollary 3.3.1. Fix an (m\n)-hook partition A and a content \i. The number 
of b-semistandard tableaux of shape A and content [i is independent of the choice of b. 
In particular, there is a well-defined number K^ 71 ^ = which is an analogue of the 

Kostka number K\ tfl . 

Example 3.3.2. Consider fll(2|l) and A = (3,2,1) 
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Consider two different e-S sequences b± = b = 55e and 62 
all possible b\- semistandard tableaux of shape A are 



5e5. One may check that 



1 


1 


1 


2 


2 




1 






1 


1 


2 


2 


1 




1 







1 


1 


1 


2 


1 




1 






1 


1 


1 


2 


2 




1 







and all possible b2-semistandard tableaux are 



1 


1 


1 


1 


2 




2 






1 


1 


1 


1 


2 




2 







1 


1 


1 


1 


2 




1 






1 


1 


1 


1 


2 




2 







H 




2 


2 


2 




1 






1 


2 


2 


2 


1 




1 






1 


1 


2 


1 


2 




2 






H 


T 


2 


1 


2 




2 







1 


1 


1 


2 


1 




1 






1 


2 


x 


2 


T 




1 






1 


1 


1 


1 


2 




1 






H 


1 


2 


1 


2 




1 







Hence the number of semistandard tableaux are the same. 

In both cases, there are two semistandard tableaux with content (l 2 ,2 2 j l 2 ) and there is 
only one semistandard tableau for other possible contents. 
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